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Abstrad 

The purpose of this study was to examine learning strategies accounted for mathematics achie¬ 
vement across Turkey and neighboring countries. Turkey, Bulgaria, Greece, Azerbaijan, Russian 
Federation, Israel, Serbia, Romania and Jordan were involved in Programme for International 
Student Assessment (PISA 2009] study. Since other neighbors of Turkey were not participated in 
PISA study, they were not evaluated. In this study, PISA mathematics test score and questionnaire 
responses of 17224 students aged 15 year-old were analyzed via multilevel models. Three-level 
model was used to estimate coefficients and to model differences across countries and schools. 
At the first level, gender, socio-economic status (SES), elaboration, memorization, control stra¬ 
tegy, home educational resources and cultural possession were considered and it was determined 
that all the variables except memorization strategy had positive effect on students' mathema¬ 
tics achievement. School size and student-teacher ratio were considered at the second level and 
gross domestic product [GDP] was considered at the third level. At the second and third level, it 
was revealed that all the variables except student-teacher ratio had a positive effect on students' 
achievement. The signs of significant coefficients on students' mathematics scores for each co¬ 
untry were shown by using two- level regression. These results were crucially important for the 
education system to be effective in terms of increasing students' mathematics achievement due 
to the fact that changing school climate and improving the learning strategies are much easier to 
achieve than changing other variables affecting students' performance. 
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A lot of factors and various strategies affect stu¬ 
dents’ learning abilities. Therefore, using these 
strategies and applying these factors in appropri- 

a Serpil KILIQ is currently a research assistant at 
Faculty of Arts and Sciences, Department of Sta¬ 
tistics. Her research interests include measuring 
the performance of education and statistical mo¬ 
deling for the purposes of determining the variab¬ 
les influencing achievement in national and in¬ 
ternational exams. Correspondence: Res. Assist. 
Serpil KILIQ, Yildiz Technical University, Faculty of 
Arts and Sciences, Department of Statistics, Da- 
vutpa$a Campus, 34220, Esenler-istanbul/Turkey. 
E-mail: serkiliddyildiz.edu.tr Phone: +90 212 383 
4424. Fax:+90 212 383 4420. 


ate and right way is important in helping students 
to reach their optimum learning abilities. Among 
these strategies, using reflective thinking and 
minimizing rote memorization optimize students’ 
learning strategies (Halpern, 1998; Snow, 2002). 
In addition, it is inevitable that there would be 
difference between learning and success among 
countries (Gow et al., 1996 cited in Chiu, Chow, & 
McBride-Chang, 2007). Besides country properties 
like socio-economic status [SES] (Demir & Kili<;., 
2008, 2010), country GDP also affects student suc¬ 
cess along with learning strategies (Chiu & Xihua, 
2008). Recent studies (Chiu et al., 2007; Fonseca, 
Valente, & Conboy, 2011) also indicate that, vari¬ 
ables such as gender, social and cultural values, 
school size and teacher-student ratio might also 
have influence on student success. 
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Purpose and Significance of the Study 

This study aims to exhibit two main purposes first 
of which is to construct a hierarchical model in 
order to find the variables which affect students’ 
mathematical success. The second purpose is to 
compare the findings of the model among coun¬ 
tries and determine Turkeys place. After obtain¬ 
ing model results, suggestions have been made 
for the improvement of mathematical success in 
Turkey. 

Method 

PISA 

PISA whose results have been published in every 
3 years since 2000 is a project that researches level 
of knowledge and skills of 15 years old students in 
industrialized countries. A total of 75 countries 
including 34 OECD members and 41 non-OECD 
members participated in PISA 2009. Turkey stage 
tests and surveys of PISA 2009 project were ap¬ 
plied to 4996 students from randomly selected 170 
schools around 12 regions of Turkey in May 2009. 

Data Set 

In this study, Turkey, Bulgaria, Romania, Azerbai¬ 
jan, Russia Federation, Israel, Greece, Serbia and 
Jordan are selected as subject countries and PISA 
2009 data sets from these 9 countries have been 
used. Two criteria were determined for the selec¬ 
tion of the countries: First, geographic coordinates 
and distance to Turkey are taken into account. Sec¬ 
ondly among those countries, the ones participated 
in PISA 2009 are selected. Data set is consisted of 
17224 students aged 15 years old from 9 subject 
countries. Since variables that affect mathemati¬ 
cal success of students is the focus of the current 
study, mathematic success is chosen as the depen¬ 
dent variable. In addition, 10 different variables are 
chosen as independent variables which are thought 
to be influencing mathematical success. 

Variables 

Mathematical success is chosen as dependent vari¬ 
able and it is tried to be explained by using a three 
staged hierarchical linear model. For this purpose, 
three different levels were determined for 10 differ¬ 
ent independent variables: student level variables, 
school level variables and country level variable 
respectively. 


Student level variables include, gender (Chiu & Xi- 
hua, 2008; Fonseca et al., 2011; Wofimann, 2003; 
Wofimann 8c West, 2006), home education re¬ 
sources (Chiu 8c Khoo, 2005; Parcel 8c Rufur, 2001; 
Wofimann), socio - economic and cultural level 
(Baker, Goesling, 8c Letendre, 2002; Chiu 8c Xihua; 
Fonseca et al.) and cultural possession (Dumais, 
2002; Hofstede, Neuijen, Ohayv, 8c Sanders, 1990) 
variables. Learning strategies are also taking place 
in student level variables which are memorization 
strategy (Chiu et al., 2007; Czuchry 8c Dansereau, 
1998; Isaacs 8c Carroll, 1999), elaboration strategy 
(Halpern, 1998; Kang, 1997; Kincannon, Gleber, 
8c Kim, 1999; Teong, 2003; Vermunt 8c Vermetten, 
2004) and control strategy (Chiu et al.; Egitim 
Ara§tirma ve Geli§tirme Dairesi Ba§kanligi [EAR- 
GED], 2007, 2010). School level variables consist 
of two variables: School size (Cotton, 1996; Lee 8c 
Loeb, 2000; Wofimann 8c West) and teacher-stu¬ 
dent ratio (Cotton). Country level variable includes 
only one variable which is gross domain product 
(Chiu 8c McBride-Chang, 2006; Worldbank 2009; 
Wofimann). 

It should be also noted that the variables except 
school size, teacher-student ratio, gender and log 
GDP are all form of indices and can be found in 
the PISA 2009 data. Socio-economic and cultural 
status index is formed with the combination of 
three variables which are parents’ highest educa¬ 
tion level, parents’ highest job status and resources 
at home. Similarly, a home education resource is 
an index that measures whether a student has suf¬ 
ficient study environment and sufficient education 
resources at home. Another index is the cultural 
possession index. Indices are for the comparison 
purpose only and a higher index shows that vari¬ 
able has more impact on the mathematical success. 

Analysis 

In this study, multilevel models have been con¬ 
structed in order to explain mathematical success. 
Samples gathered from hierarchical structure are 
called as multi-level samples and it is assumed that 
samples are taken from high level units firstly and 
then from the sub-units (Heck & Thomas, 2000). 
Such sampling method provides the advantage of 
more homogenous sub-samples when compared to 
simple random sampling (Hox, 1998). Multilevel 
models are especially needed in case of hierarchi¬ 
cal structure since this type of data violates the 
assumption of independency of units (Osborne, 
2000). Besides, multilevel models are also being 
used at a wide variety of fields including health, 
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psychology and education. This type of model is 
also very useful and efficient when someone wants 
to determine and control clustered structures and 
heteroscedasticity (Raudenbush & Bryk, 2002). 
SAS 9.1 Statistical Package Program is being used 
for the study. First level of the data set consists of 
students while second level represents schools and 
third level denotes countries. 

Findings and Results 

Results of the three leveled hierarchical model are 
shown at Table-1. According to the table, male stu¬ 
dents are more successful than female students. 
Moreover, in general terms it can be interfered that, 
SES, home resources, cultural possession have an 
increasing effect on mathematical success. Among 
learning strategies, while elaboration and control 
strategy have a positive effect on mathematical suc¬ 
cess, it is shown that memorization has converse 
effect. When school level variables are analyzed, it 
can be seen that larger schools provide more math¬ 
ematical success. However, as students per teacher 
increase, mathematical success decreases. 

l:Male; 2: Socio - Economic Status; 3: Home Edu¬ 
cation Resources; 4: Cultural Possession; 5: Memo¬ 
rization; 6: Elaboration; 7: Control Strategy; 8: Stu¬ 
dent Teacher Ratio; 9: School Size 

Looking closer to the Table-1, the differences 
among countries are easily seen. Empty cells state 
that variables have no significant effect on students’ 
mathematical success. Moreover, every coefficient 
in the model is significant at least p= 0.05 level. 
Genders effect is very high especially at Romania, 
Israel, Greece, Turkey and Serbia. There are at least 
20 points of difference between males and females 
at those countries while this difference is relatively 
low at Russia, Bulgaria and Azerbaijan. Socio-eco¬ 
nomic and cultural status mainly affect mathemati¬ 


cal success at Israel, Russia, Bulgaria and Greece. 
Azerbaijan is the least affected country in terms of 
this variable. Home education status has an effect 
mostly in Russia and Romania while it affects fewer 
students at Turkey, Azerbaijan and Serbia. Cultural 
possession is especially significant at Bulgaria and 
Serbia but also it should be noted that it has nega¬ 
tive effect on students at Jordan and no effect could 
be found at Azerbaijan. When it comes to learning 
strategies, it is seen that memorization has negative 
effect on mathematical success. This effect is really 
high at all the countries except Azerbaijan. It can 
also be interfered that memorization did not affect 
Jordan. Elaboration is statistically significant in 
only five countries in which Greece, Jordan, Serbia 
and Turkey showed positive relation with the vari¬ 
able but, Russia showed negative relation. Control 
strategy influences mathematical success positively 
for all the countries. This influence is high at Israel, 
Russia, Greece, Jordan and Turkey. Increase at the 
class size tends to decrease success in mathematics 
with the exception of Greece. All other countries 
impacted negatively from this variable at a statis¬ 
tically significant level where Bulgaria and Israel 
seemed to be affected most. The last variable is 
school size which is significant only in four coun¬ 
tries including Bulgaria, Russia, Serbia and Israel 
where this effect is low. 

Discussion and Suggestions 

It can be easily seen from Graph-1, students’ math¬ 
ematical success are affected differently from vari¬ 
ables. This study showed that most of the variables 
influence mathematical success positively with two 
exceptions which are memorization and teacher- 
student ratio. 

Recent studies show that male students have higher 
mathematical achievement than females (Chiu & 


Table 1. 

Coefficient Values of Multilevel Hierarchical Regression for Mathematical Success 



1 

2 

3 

4 

5 

6 

7 

8 

9 

TURKEY 

21.8529* 

8.2412* 

2.8477* 

1.7745** 

-15.7827* 

3.6321* 

10.8496* 

-2.8012* 


GREECE 

22.5499* 

14.1103* 

4.8035* 

3.4132* 

-13.5335* 

7.0311* 

13.9615* 

3.9905** 


BULGARIA 

8.5727* 

14.2238* 

3.7197* 

11.9955* 

-7.9751* 


5.4133* 

-7.7819* 

0.1248* 

AZERBAIJAN 

10.3256* 

2.8325* 

2.1037* 


-3.5867* 


6.7033* 



RUSSIA FED. 

7.0526* 

16.4162* 

10.4458* 

4.8873* 

-17.1784* 

-2.3719** 

14.9055* 

-1.8855* 

0.03065* 

ROMANIA 

29.3791* 

6.9974* 

6.8136* 

4.0581* 

-7.0192* 


5.2772* 



JORDAN 


9.9326* 

7.3237* 

-2.4742* 


5.6819* 

11.3181* 

-1.2750** 

0.03836* 

SERBIA 

21.7494* 

4.3389* 

2.7144* 

8.8723* 

-18.6204* 

5.6144* 

9.3144* 



ISRAEL 

25.2274* 

17.8976* 


6.2800* 

-17.0903* 


17.3732* 

-5.3771* 

0.05139* 

*p<0,01 **p< 0,05 
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Xihua, 2008; Fonseca, et al., 2011; Wofimann, 2003; 
Wofimann & West, 2002). The results of the current 
study confirmed the results of these studies in that 
it was found that in all countries being male has a 
positive effect on mathematical success. This effect 
is especially high in Romania, Israel, Greece, Turkey 
and Serbia. Besides, it was noted that gender does 
not statistically affect mathematical success in Jor¬ 
dan. On the other hand, according to recent studies 
that, SES, home education resources and cultural 
possession should have positive effect on math¬ 
ematical success (Baker et al., 2002; Chiu & Khoo, 
2005; Chiu & Xihua, 2008; Dumais, 2002; Hofstede 
et al., 1990; Parcel & Rufur, 2001; Wofimann, 2003). 
As seen on the graph, this finding of the studies has 
been almost met at a statistically significant level in 
countries. Socio-economic status has influence es¬ 
pecially in Israel, Russia, Greece and Bulgaria while 
home education resources are important in Russia. 
Cultural possession is especially high in Bulgaria 
and Serbia. Results of the multilevel model showed 
that results of learning strategies are in line with the 
results of previous studies (Chiu et al., 2007; Halp- 
ern, 1998; Isaacs & Carroll, 1999; Kang, 1997; Ver- 
munt & Vermetten, 2004) which determine while 
memorization affects success negatively, elabora¬ 
tion and control strategy affect it positively. All of 
the countries are adversely affected from memo¬ 
rization and positively affected from elaboration 
and control strategy. The only exception is Russia 
which is affected negatively from elaboration strat¬ 
egy. Serbia, Israel, Russia, Turkey and Greece is ad¬ 
versely affected by the memorization at significant 
level while Greece, Jordan and Serbia gain the most 
benefit from elaboration and Israel, Russia, Greece 
and Turkey take the advantages of control strategy. 
Teacher-student ratio indicates that higher number 
of students per teacher decreases student success 
(Cotton, 1996). Same result stands for this study 
with the exception of Greece. 


Graph 1. Coefficient Values of Multilevel Hierarchical Re¬ 
gression for Mathematical Success with Histogram 


Looking from Turkish students’ perspective, it can 
be said that Turkish students might have troubles 
in reaching education resources since this variable 
does not affect mathematical success too much. In¬ 
troducing more home education resources to the 
students would bring more success in mathemat¬ 
ics. Same argument can be valid for the cultural 
possession too. This effect might be due to lack of 
directing students to leisure time activities such 
as art and books. It can be suggested to teachers 
that either they should give place to leisure time 
activities in their classes or encourage students to 
do so. Looking at the learning strategies, it can be 
understood that Turkey has been immensely af¬ 
fected from memorization. This is due to struc¬ 
ture of Turkish education system depending on 
memorization. Restructuring curriculum and 
changing learning strategies from memorization 
to elaboration and control strategy would im¬ 
prove mathematical success of students. Despite 
of the negative result of memorization Turkey 
takes a firm place both in elaboration and control 
strategy. This result shows that Turkish students 
can use metacognitive strategies if the chance is 
given and they could combine old learning with 
the new ones efficiently. Meanwhile, according to 
the analysis of the results, Turkey has the highest 
teacher-student ratio and this situation obstructs 
students’ mathematical success. In order to solve 
this problem, number of teachers should be in¬ 
creased immediately. 
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